Evaluation of a High Performance Erasure Code Implementation
نویسندگان
چکیده
Frank Uyeda, Huaxia Xia, Andrew A. Chien Computer Science and Engineering Department University of California, San Diego {fuyeda, hxia, achien}@ucsd.edu September 9, 2004 Abstract We examine the properties and performance of LT Codes for use in a high performance distributed file system. Different variations to the algorithm were created to achieve key characteristics, such as speed and data reliability. Finally, we evaluate parameter choices in order to balance the system and network loads.
منابع مشابه
A Non-MDS Erasure Code Scheme for Storage Applications
This paper investigates the use of redundancy and self repairing against node failures indistributed storage systems using a novel non-MDS erasure code. In replication method, accessto one replication node is adequate to reconstruct a lost node, while in MDS erasure codedsystems which are optimal in terms of redundancy-reliability tradeoff, a single node failure isrepaired after recovering the ...
متن کاملSoftware-Based Erasure Codes for Scalable Distributed Storage
This paper presents a new class of erasure codes, Lincoln Erasure codes (LEC), applicable to large-scale distributed storage that includes thousands of disks attached to multiple networks. A high-performance software implementation that demonstrates the capability to meet these anticipated requirements is described. A framework for evaluation of candidate codes was developed to support in-depth...
متن کاملErasure Code with Shingled Local Parity Groups for Efficient Recovery from Multiple Disk Failures
The ever-growing importance and volume of digital content generated by ICT services has led to the demand for highly durable and space-efficient content storage technology. Erasure code can be an effective solution to such requirements, but the current research outcomes do not efficiently handle simultaneous multiple disk failures. We propose Shingled Erasure Code (SHEC), an erasure code with l...
متن کاملBi-Endian Compiler: A Robust and High Performance Approach for Migrating Byte Order Sensitive Applications
In this paper, we describe the implementation and performance evaluation of a bi-endian capable compiler. Software migration of legacy applications from one endian architecture to another is oftentimes hampered by byte order dependencies hidden in the source code. These dependencies can be expensive to find and address in a systematic fashion. We introduce the Bi-endian Compiler (BEC) capable o...
متن کاملDesign and Implementation of LH*RS: a Highly Available Distributed Data Storage System
The ideal storage system is always available and is incrementally expandable. Existing storage systems are far from this ideal. Affordable computers and high-speed networks allow us to investigate storage architectures that bring us closer to the ideal storage system. We describe a prototype implementation of the highly available scalable distributed data structure LH*RS. The scheme allows to r...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004